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USER-CONTROLLED EXPOSURE METHOD AND SYSTEM 
WITH VISUAL FEEDBACK 

FIELD OF THE INVENTION 

The present invention relates generally to digital cameras, and more particularly, to a 
user-controlled exposure method and system with visual feedback. 

BACKGROUND OF THE INVENTION 

Low light situations create difficult conditions for photographers attempting to 
capture a scene under these low light conditions. Low light situations typically require a 
long exposure time for the camera to collect enough light for a useful and pleasing 
image. 

Photographers have used long exposure times (e.g., many seconds to many 
minutes) in order to collect enough light for the image to be sensed. In one approach, 
light meters are employed in order for the photographer to gauge approximately how 
long to expose the film. Unfortunately, this process involves "trial and error" and 
guesswork. 

When a film camera is utilized, a photographer "brackets" the scene by trying 
several exposure times, where there is one exposure time for each frame of film. When 
the film is later developed, the photographer simply picks the best exposure or the best 
overall image. As can be appreciated, this process wastes film and does not guarantee 
an acceptable image. Moreover, by the time the photographer realizes that the exposure 
times employed are incorrect, the scene is no longer available for capture. 
Consequently, this approach creates missed opportunities and the inability to go back in 
time to re-capture the scene. 

When a digital camera is utilized, the problem is lessened in that the image can 
typically reviewed by the photographer at the location of the image capture without the 
delay of having to process the film in a darkroom. In other words, the user receives 
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feedback from a digital camera after the image is captured. For example, a photographer 
can view the pictures after the photographer shoots the picture. The user can then select 
the best pictures and delete the remaining pictures without wasting film. In this manner, 
the photographer does not waste money on developing film and printing photos that are 
not of value to the photographer. 

However, even in this second approach that uses a digital camera, the selection 
of a "good" exposure occurs after the fact (i.e., after the picture has been taken). In the 
event the picture is not "good", the scene must be re-shot in order to obtain the proper 
exposure. As can be appreciated, this "trial and error" method can result in missed 
photographic opportunities in a variety of different situations. For example, a setting 
moon or other scene that has changing parameters. 

Accordingly, it would be desirable for there to be a mechanism that provides 
visual feedback to the photographer during exposure of a picture so that a photographer 
can control the exposure time based on the visual feedback. 

Based on the foregoing, there remains a need for a user-controlled exposure 
method and system with visual feedback that overcomes the disadvantages set forth 
previously. 
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SUMMARY OF THE INVENTION 
According to one embodiment of the present invention, a user-controlled 
exposure method and system with visual feedback are described. 

One aspect of the present invention is the provision of a user-controlled exposure 
5 mechanism that reduces or eliminates the lost opportunities for a photographer due to 
incorrect exposure time. 

Another aspect of the present invention is the provision of a user-controlled 
JT exposure mechanism that provides visual feedback to the photographer during the 
H! capture of a scene. 
! 1 0 Another aspect of the present invention is the provision of a user-controlled 

exposure mechanism that allows a photographer to control the exposure time during the 
2 capture of a scene based on visual feedback of current exposure. 

W Another aspect of the present invention is the provision of a user-controlled 

exposure mechanism that reduces the "trial and error" guesswork of prior art approaches 

M=15 for long exposure time scenes. 

Another aspect of the present invention is the provision of a user-controlled 
exposure mechanism that does not require a light meter that is often utilized by one prior 
art approach. 

According to one embodiment, a digital image capture device (e.g., a digital 
20 camera) that has a user-controlled exposure mode is described. The camera has a first 
button for use by a user to assert a start exposure signal, a second button for use by a 
user to assert a terminate exposure signal, and a third button for use by a user to set the 
digital camera into the user-controlled exposure mode. A display is provided for 
displaying images. The camera includes a user-controlled exposure mechanism that is 
25 coupled to the first button, the second button, the third button, and the display. The 
user-controlled exposure mechanism begins an exposure upon receipt of an asserted start 
exposure signal and provides visual feedback during the exposure through the display. 
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Furthermore, the user-controlled exposure mechanism allows a user to either continue 
an exposure or terminate the exposure by employing the second button. 

Consequently, the user-controlled exposure mechanism of the present invention 
provides feedback (e.g., visual feedback) to the photographer during the exposure of an 
5 image, thereby providing the photographer with an opportunity to continue the exposure 
to capture more light or to terminate the exposure when the camera has captured 
sufficient light. 

According to another embodiment, a digital image capture device (e.g., a digital 
« camera) is provided with a mechanism for supporting a manual exposure mode in which 
111 10 a user can control the exposure time for the picture. A user first places the camera into 

the manual exposure mode. Then, a user initiates the picture taking process by, for 
~ example, depressing a shutter button. The user then reviews the picture on a display as 

fy the picture develops. When the picture has the desired exposure, the user terminates the 
"J* picture taking process by, for example, releasing the shutter button. In this manner, a 
H15 photographer obtains a picture with the desired exposure without the delay, additional 

equipment, and guesswork involved in prior art approaches. 

Other features and advantages of the present invention will be apparent from the 

detailed description that follows. 
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BRIEF DESCRIPTION OF THE DRAWINGS 
The present invention is illustrated by way of example, and not by way of 
limitation, in the figures of the accompanying drawings and in which like reference 
numerals refer to similar elements. 
5 FIG. 1 illustrates a digital image capture device in which the user-controlled 

exposure mechanism of the present invention may be implemented. 

FIG. 2 is block diagram illustrating in greater detail the digital image capture of 
FIG. 1 in accordance with one embodiment of the present invention. 
J? FIG. 3 is a flow chart illustrating the steps performed by the user-controlled 

Hf 10 exposure mechanism of FIG. 1 in accordance with one embodiment of the present 
N invention. 

Wl FIG. 4 is a flow chart illustrating the steps performed by the user-controlled 

M= exposure mechanism of FIG. 1 in accordance with an alternative embodiment of the 
ry present invention. 

pi 5 FIG. 5 illustrates exemplary running total images at different stages of an 

exposure. 
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DET AILED DESCRIPTION 
A user-controlled exposure method and system with visual feedback are 
described. In the following description, for the purposes of explanation, numerous 
specific details are set forth in order to provide a thorough understanding of the present 
5 invention. It will be apparent, however, to one skilled in the art that the present 
invention may be practiced without these specific details. In other instances, well- 
known structures and devices are shown in block diagram form in order to avoid 
unnecessarily obscuring the present invention. 
O The user-controlled exposure method and system with visual feedback can be 

|ij 10 implemented in any digital camera architecture that employs an imaging sensor (e.g., a 
Cj CDD imaging sensor). The photographer accesses this feature by setting the digital 
jjj camera into a user-controlled exposure mode prior to taking a picture. Once in the user- 
y: controller exposure mode, the photographer simply pushes the shutter release button and 
views the developing scene on the camera's digital display while the exposure is 
J! 15 occurring. When the exposure appears correct to the photographer, or the scene is 
pleasing to the photographer, the photographer simply pushes the shutter button again 
(or other button as defined by the specific camera design) in order to terminate the 
exposure. The final image is then stored in the same manner that other standard pictures 
are stored. An exemplary digital image capture device (e.g., a digital camera) is now 
20 described with reference to FIG. 1 . 

Digital Camera 100 

A digital camera 100 includes a first button 1 10 for use by a user to assert a start 
exposure signal 1 14, a second button 120 for use by a user to assert a terminate exposure 
25 signal 124; and a third button 130 for use by a user to assert an enable user-controlled 
exposure mode signal 134, thereby setting the digital camera 100 into the user- 
controlled exposure mode. It is noted that the first button 1 10 and the second button 120 
can be the same button, such as a shutter control button. 
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The user-controlled exposure mechanism 140 is coupled to the first button to 
receive a start exposure signal, to the second button to receive a terminate exposure 
signal, to the third button to receive the enable user-controlled exposure mode 
(EUCEM) signal, and to the display 150. 

The digital camera 100 includes a user-controlled exposure mechanism 
(EUCEM) 140 that is activated when the camera is set for a user-controlled exposure 
mode (UCM). When in the UEM, the user-controlled exposure mechanism 140 begins 
an exposure upon receipt of an asserted start exposure signal and allows a user to 
selectively continue an exposure or terminate the exposure by employing the second 
button 120. The user-controlled exposure mechanism 140 includes a visual feedback 
module 144 for providing feedback (e.g., visual feedback) to the photographer through a 
display 150 during the exposure. The user-controlled exposure mechanism 140 is 
especially adept at handling long exposures (e.g., exposures greater than one or two 
seconds). 

The digital camera 100 also includes a display 150 for displaying images 
captured by the camera, and as described in greater detail hereinafter, frames in an 
exposure and running total images (RTIs) 156 that are calculated by the user-controlled 
exposure mechanism of the present invention. The display 150 can be, for example, a 
liquid crystal display (LCD) screen for displaying pictures and also graphical user 
interface for allowing a user to configure the camera or otherwise select options for the 
display. It is noted that the display can be implemented with technologies, such as 
cathode ray tubes (CRTs), organic light emitting diodes (OLEDs) and other technologies 
suitable for portable devices. 

FIG. 2 illustrates in greater detail the digital image capture device 100 (e.g., a 
digital camera) of FIG. 1 in accordance with one embodiment of the present invention. 
The digital camera 100 further includes a lens 210, a shutter 220, an image sensor 230, 
and an analog/digital converter (A/D converter) 240. 
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The digital camera 100 also includes a memory 250 for storing a plurality of 
frame buffers 260 (e.g., frame buffer^l, frame buffer_2, .. , frame buffer_n) and a final 
buffer 264. The number of frame buffers 260 depends on factors, such as the size of 
storage, the predetermined time interval between capture of images. The final buffer 
264 stores a final image that is a composite of all the frame buffers (i.e., final buffer data 
= frame buffer_l data + frame buffer_2 data + ... + frame buffer__(n-l) data + buffer_n 
data). 

The digital camera 100 can also include a permanent storage. The storage can be 
a Flash memory card or other storage device. For example, the camera 100 can include 
a memory compartment for receiving a memory card for storing pictures. The memory 
card may be in a standard format, such as Compact Flash, SmartMedia, Memory Stick, 
and come in a standard size (e.g., 4MB, 8MB, 16MB, 32MB, and 64MB). 

The digital camera 100 also includes a processor 280 (e.g., a micro controller) 
for executing program instructions. In the preferred embodiment, the UCEM 140 of the 
present invention may be embodied as a program for managing the manual shutter 
control for long exposures. It is noted that the UCEM 140 can be implemented by 
software, hardware, firmware, or a combination thereof. 

The digital camera 100 also includes a control logic block 270 for controlling the 
shutter 220, image sensor 230 and the A/D converter 240. The control logic block 270, 
for example, performs one or more of the following functions: 

1. Open the shutter, if necessary; 

2. Clock the image sensor so as to capture an image and shift out the analog 
voltage representation of the image; 

3. Clock the Analog to Digital Converter so as to correctly convert the analog 
voltage into digitally coded data; and 

4. Adjust zoom and' focus motors (not shown), if applicable, under direction 
from a microprocessor. 
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The operation and construction of the control logic block 270 are known by 
those of ordinary skill in the art and is not described in greater detail herein. 

It is noted that shutter 220 is shown as a mechanical shutter. Alternatively, 
shutter 220 may be implemented with an electronic shuttering mechanism that is 
5 integrated with the control logic block 270. 

The digital camera 100 also includes a plurality of buttons 290 for use by the 
user to control the functions of the digital camera. For example, the digital camera 100 
can include a menu button, a select button, and a navigation button having an up arrow, 
O left arrow, right arrow, and down arrow. The buttons 290 can include the buttons 
UJ 10 described earlier that can be utilized by the UCEM 140 of the present invention to place 
SI the camera into a user-controlled mode, to start the exposure, and to terminate the 
m exposure. 

u= The terminate exposure signal or close shutter signal, for example, can be 

pj asserted by using a cable release or a remote control In this manner, unwanted vibration 
gl 5 of the digital camera that can result from the photographer's touching the camera buttons 
is prevented. It is noted that the state of a single signal may be used to start or terminate 
the exposure. For example, the terminate exposure signal may be a de-asserted start 
exposure signal In this case, a shutter may be open and closed by asserting or de- 
asserting a single signal (e.g., the start exposure signal). 
20 For example, a remote control can utilize an infrared (IR) link, radio frequency 

(RF) link, or other communication link to transmit a command to assert the start 
exposure signal (e.g., an open shutter signal) and the terminate exposure signal (e.g., a 
close shutter signal). When the user is satisfied with the amount of exposure of a 
particular picture, the user simply asserts the terminate exposure signal (e.g., a close 
25 shutter signal), and the picture taking process (i.e., the exposure) terminates. 

The digital camera 100 also includes a bus 284 for communicating running total 
image (RTI) to the display 150 and for communicating the frame buffers 260 and 
running total image (RTI) to the processor 280 for processing. 
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Processing Steps 

FIG. 3 is a flow chart illustrating the steps performed by the user-controlled 
exposure mechanism of FIG. 1 in accordance with one embodiment of the present 
5 invention. When the camera is in a user-controlled exposure mode, and the start 
exposure signal is asserted, the following steps are performed. In step 300, the digital 
camera 1 00 captures a first frame in the exposure. The capturing step can include the 
sub-steps of exposing the image sensor 230, reading out an analog value from the image 
sensor 230, and converting the captured analog value into a corresponding digital value. 
U10 In step 310, the first frame is stored as a running total image (RTI). In step 320, 

M the running total image (RTI), which at this point in time is the same as the first frame, 
m is displayed. For example, the running total image (RTI) can be displayed on a liquid 
y* crystal display of the digital camera for viewing by a user. In step 330, a next frame is 
ry captured. In step 340, the next frame captured in step 330 is added to the running total 
pi 5 image. At this point in time, the running total image (RTI) is the sum of the first frame 
and the second frame. In step 350, the updated running total image (RTI) is displayed. 

In decision block 360, a determination is made whether a terminate exposure 
signal has been asserted. The terminate exposure signal can be, for example, a close 
shutter signal or a de-asserted start exposure signal. When the terminate exposure signal 
20 has been asserted, the running total image is stored into a final buffer in processing step 
370. The value in the final buffer is the sum of all frames captured in the time interval 
from the start of image capture (e.g., the time when the user presses the shutter button) 
to the time when the terminate exposure signal is asserted (e.g., when the user releases 
the shutter button by using a cable release). 
25 Step 370 can also include the sub-step of storing the final image into a storage 

media (e.g., a volatile memory, a non-volatile memory, or a removable storage media). 

When the terminate exposure signal has not been asserted, the processing 
continues at step 330 for processing the next frame. Steps 330 to 350 are repeated at a 
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predetermined time interval until the terminate exposure signal (e.g., the close shutter 
signal) is asserted. In this manner, the user-controlled exposure mechanism of the 
present invention enables a photographer to manually control the exposure time for a 
picture based on a continuous readout and display of a running total image. 
5 FIG. 4 is a flowchart illustrating the processing steps performed by an exemplary 

implementation of the user-controlled exposure mechanism of the present invention in a 
digital image capture device (e.g., a digital camera). The digital image capture device 
ijl ^as a user-controlled exposure mode. When the user-controlled exposure mode is 
enabled, and the start exposure signal is asserted, steps 400 to 490 are performed. In 
Hf 10 step 400, a sensor (e.g., a CCD imaging sensor) is exposed. In step 410, the sensor is 
N read out, and the image is converted into digital data. In step 420, the data is stored into 
m a first location (e.g., a temporary location). In step 430, the captured image is displayed 
N= on a digital display for viewing by the photographer. In step 440, the sensor is exposed 
r0 again. In step 450, the sensor is read out, and the new image is converted into digital 
pi 5 data. In step 460, the new data is added to the previously captured data. In step 470, 
resulting data from the addition operation is displayed on the digital display. 

In decision block 480, a determination is made whether an exposure terminate 
signal has been asserted. When the exposure terminate signal has not been asserted, 
steps 440 to 470 are repeated until the photographer terminates the exposure by, for 
20 example, closing the shutter by asserting the terminate exposure signal. 

When the exposure terminate signal has been asserted, in step 490, the final 
image is transferred to a second location (e.g., a permanent location), which can be, for 
example, a volatile memory, a non- volatile memory, or a removable storage media. 

It is noted that steps 440 to 470 can be performed as quickly as allowed by the 
25 camera design and is typically a fraction of a second. The user-controlled exposure 
mechanism of the present invention is especially suited for exposures that last longer 
than one or two seconds because exposures shorter than about one or two seconds are 
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difficult to control due to human limitations in recognizing a correctly exposed scene 
and stopping the exposure before too much light is captured. 

FIG. 5 illustrates exemplary running total images at different stages of an 
exposure. A first frame (F^ 500 is captured. The running total image 504 is then 
5 displayed. At this point in time in the exposure, the running total image 504 only 
includes Fi. A second frame (F 2 ) 510 is then captured. The running total image 504 is 
then displayed. The running total image 514 at this point in time in the exposure 
. ^ includes F t and F 2 and is the sum thereof. Successive frames are captured and displayed 
in a similar manner. 

"r^lO An Nth frame (F N ) 520 is captured. The running total image 524 prior to the 

capture of the Nth frame 520 includes F b F 2 , F 3 , .., F^ and is a sum thereof. A final 
01 image 530 is the sum of all the frames F) to F N . 

H In this embodiment, each pixel can have a value in the range of 0 to 255 or in the 

fj range of 0 to 1023. Typically, a zero value represents black (e.g., absence of light or 
Ol5 very low light) and the highest value in the range (e.g., 255 or 1023) represents white 
(e.g., bright light). 

However, it is understood by those of ordinary skill in the art that the range of 
pixel values, which depends on the number bits utilized to represent each pixel, can be 
varied to suit a particular application. When eight bits are used to represent each pixel, 

20 the pixel value can be in the range of 0 to 255. Similarly, when ten bits are used to 
represent each pixel, the pixel value can be in the range of 0 to 1023. Similarly, when 
twelve bits are used to represent each pixel, the pixel value can be in the range of 0 to 
4096. It is noted that twelve, sixteen, twenty or M bits of data can be used to represent 
each pixel depending on the requirements of a particular application. 

25 For those scenes that require a long exposure; each successive frame is added to 

the running total until the displayed version of the scene is acceptable to the user. 
Specifically, the value at each pixel location is summed across all the frames (1 to N). 
For example, for the pixel at location (1,1), the final image is the sum of pixel values at 
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location (1,1) across all the frames (i.e., Fjotal (1,1) = F_l(l,l) + F__2(l,l) + F_3(l,l) + 
.. + FN(1,1)). 

The user-controlled exposure mechanism of the present invention obviates the 
need for a light meter, the guesses as to exposure time, and re-takes of a scene after the 
image review after the fact has revealed inadequate lighting for a picture. The user- 
controlled exposure mechanism of the present invention provides visual feedback, 
complete control of the exposure time, and assurance that a scene is captured that meets 
with the expectations of the photographer. 

In the foregoing specification, the invention has been described with reference to 
specific embodiments thereof. It will, however, be evident that various modifications 
and changes may be made thereto without departing from the broader scope of the 
invention. The specification and drawings are, accordingly, to be regarded in an 
illustrative rather than a restrictive sense. 



